Papers with state space model
GL-GAN: Perceiving and Integrating Global and Local Styles for Handwritten Text Generation with Mamba (2025.coling-main)
Copied to clipboard
| Challenge: | Existing models lack the ability to perceive and integrate handwriting styles, which affects the realism of the synthesized samples. |
| Approach: | They propose a Hybrid Style Encoder that captures global and local styles and integrates them into a Dynamic Feature Enhancement Module (DFEM). |
| Outcome: | The proposed model outperforms state-of-the-art models on two widely used handwriting datasets and can provide training data for handwritten text recognition and signature verification. |
DenseSSM: State Space Models with Dense Hidden Connection for Efficient Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) face excessive computational and memory requirements due to the commonly used Transformer architecture. |
| Approach: | They propose a method to enhance the flow of hidden information between layers in large language models by selectively integrating shallow-layer hidden states into deeper layers. |
| Outcome: | The proposed method maintains parallelizability and inference efficiency of SSMs while significantly boosting performance on public benchmarks. |
Mamba Drafters for Speculative Decoding (2025.findings-emnlp)
Copied to clipboard
Daewon Choi, Seunghyuk Oh, Saket Dingliwal, Jihoon Tack, Kyuyoung Kim, Woomin Song, Seojin Kim, Insu Han, Jinwoo Shin, Aram Galstyan, Shubham Katiyar, Sravan Babu Bodapati
| Challenge: | Existing drafters that use external drafters suffer from slower drafting while self-speculation methods use drafters tailored to the target model but require re-training. |
| Approach: | They propose a drafter based on a state space model, Mamba, as a solution that combines the best aspects of both approaches. |
| Outcome: | The proposed drafters outperform existing drafters while using less memory and maintaining their cross-model adaptability. |